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It  is  obviously  important  to  monitor  p, , so  a sample  of  the 
missiles  is  tested  periodically.  Since  the  testing  is  destructive, 
the  population  is  eventually  depleted  by  the  testing.  Furthermore, 
defects  in  missile  design  may  be  uncovered,  so  modifications  may 
be  introduced  which  will  have  a tendency  to  increase  the 
reliability.  For  technical  reasons,  however,  we  choose  to  describe 
a test  which  is  designed  to  detect  a deter i orati  on  in  the 
reliability.  . . 


No  target  value  for  the  reliability  is  given  by  management,  so 
that  the  testing  at  time  t is  used  to  determine  if  there  has  been 
a change  in  the  reliability  since  time  t-1.  The  following 
requirements  are  given  and  will  be  used  to  formalize  a test  of 
hypothesis  to  accomplish  the  goals  of  the  testing  procedure. 


It  is  required  to: 


1.  detect  whether  pt  has  changed  by  an  amount  d*  since  the 
immediately  proceeding  testing  period,  with  a probability  of  at 
least  it  at  time  t=2,3,4,... 


2.  compensate  for  the  sampling  uncertainty  in 
estimate  of  p*,  in  constructing  the  test  of  hypothesis. 


P. 


the 


3.  use  the  minimum  possible  sample  sizes  in  accomplishing 
requirements  1 and  2,  above. 


Since  the  test  data  are  pass-fail  in  nature,  the  binomial 
probability  model  is  appropriate  for  describing  the  stochastic 
sample  behaviour.  Suppose  we  choose  the  test  size  to  be  <>  for  the 
hypotheses: 


H0:  p*— pt-i 

Hi:  Pt= (pt-i ) -d~ 
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Requirement  1,  above,  leads  to  a type  II  error,  Wo  are 

then  lead  to  solve  the  -following  inequalities  simultaneously  for 

n,  and  :<  f a-,  follows.  Let  B(x,nSp)  represent  the  cumulative 
binomial  probability  of  ><  or  fewer  successes  in  n trials.  That  is, 


B <x  , n 5 p ) - )p  • ( 1-p  ) "•  ■»  > 

, -ii 

Then  the  inequalities  of  interest  are: 

B (xf  ,nt  ipt)  < ,y  (1) 

D(:<r,n,  {pt-d->  2 i-y  (2) 

For  p,  , known,  the  null  hypothesis  is  rejected  if  the 
current  sample  yields  xr  or  fewer  reliable  missiles.  Since  p,.  is 
not  known,  however,  (1)  and  (2)  are  solved  after  substituting  pt 
for  pt-,  since  we  have  no  target  value  for  it.  We  will  account  for 
this  uncertainty  by  averaging  the  pair  x?,  n,  with  respect  to  the 
prior  distribution  for  ph  . First,  however,  we  shall  introduce  a 
sequential  scheme  to  reduce  the  sample  sizes  required. 

For  practical  reasons,  the  missiles  are  tested  sequentially 
in  time.  Therefore,  when  a critical  sample  value  is  obtained,  the 
sampling  may  be  curtailed.  That  is,  if  xf+1  successful  tests  or  if 

ht-xe+1  failures  are  experienced  before  the  sample  is  completed, 
then  the  test  may  be  curtailed  (terminated  prematurely)  without 
effecting  the  error  distribution  of  the  test.  The  curtailed 
sampling  distribution  is  expressed  as  follows.  Given  pt  and  x?, 
the  probability  that  nt*=x  when  a curtailed  sampling  procedure  is 
used  is: 


Ir  order  to  obtain  P[n,.=x],  we  compute  the  average  with 
respect  to  the  prior  probability  for  p,  , given  by  g(pt|  H) . In  the 
absence  of  information  to  the  contrary,  the  conjugate  prior  in 


the  binomial  cast,  is  not  only  convenient,  but  also  natural.  Thin 
prior  it  the  Beta  distribution  given  by: 

g <p  I a,  b , W)  - B~  1 ( a, b ) p*~ ' ( 1 -p ) u >,  a>l,  bM, 


where, 


B(a,b)  - r(a)r(b) /[’(a+b)  , 


P(x)  is  the  gamma  -function  Cl,  p.  2551,  and  H refers  to  the 
experimental  hypothesis  relevant  to  our  situation.  The  averaging 
process  yields: 


PCn^x  3 


S'  l(a,b)  B (x -n* +x f +a , nt -x r +b ) 

for  n t-xf <-<£_.<{• 


B Ma,b)  B (x-nt+xr  + a,  nt  -xf+b)  + (4) 


B Ma,b)  B(xf  + l+a,x-xc-l  *-b) 

for  !<?<x<nt 


The  expected  sample  size,  ECnt],  can  be  obtained  by  computing: 


ECnt]  = s xPCn*=x3 
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A full  Bayesian  treatment  of  the  problem  is  developed  as 
follows.  Equations  (1)  and  <2)  are  averaged  with  respect  to  the 
prior  as  shown  below. 


1 

B(x?,n*;pt)g  (ptlf/ldp,. 


B (xr , n*  ;p*-d)g  (p*  if/ldp* 


< c< 


> l-e 


(5) 


(6) 


Integrals  (5)  and  (6)  may  be  re-expressed  in  closed  form  which 
allows  them  to  be  solved  iteratively  for  and  l*t,  . These  values 
are  then  used  in  equations  (3)  for  computing  the  expected  sample 
sizes.  We  point  out  that  (5)  is  related  to  the  predictive 
distribution  which  is  used  for  model  checking  or  informal 
hypothesis  testing  in  the  Bayesian  context  C2,  p.3853. 
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Generally,  prior  distributions  on  unknown  parameters  involve 
parameters  of  their  own  which,  in  turn,  depend  on  the  experimental 
conditions  or  hypotheses.  In  our  example  the  parameters  are  ’a'  and 
’b’.  The  experimental  hypotheses  and  specific  parametric  values  for 
our  situatioi  are  abtained  and  applied  by  using  the  following  line 
of  reasoning.  Before  the  init.al  test,  little  or  no  a-priori 
information  is  available  about  p,  so  a flat  prior  distribution  is 
assumed.  The  uniform  prior  corr esponds  to  the  parameter  values 
a=b=l,  and  essentially  assigns  equal  weights  to  all  values  of  p, 
in  the  interval  (0,1).  After  the  first  test  sample  has  been 
obtained,  say  x,  and  n,,  the  posterior  distribution  is  a Beta 
distribution  with  parameters  a + x,  and  b+n,-x1(  The  mode  of  the 
posterior  may  be  used  as  an  estimate  for  p,.  This  is  given  by 

p i = (a  + x i - 1 ) / (a+b+n , -2) , and  as  npted  previously,  is  the  value 
against  which  the  second  sample  is  tested.  The  complete  testing 
strategy  is  outlined  below. 

1.  Before  testing  begins,  the  orior  distribution  is  defined.  This 
should  be  based  on  engineering  knowledge  and  experience  and 
developmental  history.  Since  it  is  not  usually  possible  to  obtain 
that  information  from  engineers,  it  is  imperative  to  provide  a 
reasonable  alternative.  For  this  we  suggest  using  an  initial 
sample,  correspond i ng  to  time  t=0.  The  implied  prior  for  the 
initial  sample  is  the  uniform  distribution  of  the  Beta  family. 

2.  The  monitoring  procedure  begins  with  the  first  test  sample  and 
proceeds  as  follows.  At  time  t (=»  1 , 2,  3,  . . . ) the  prior  distribution, 
g<.(.),  is  the  posterior  distribution  from  the  test  at  time  t-1,  or 
h,  ,(.).  The  mode  of  the  prior  is  the  value  for  pt.  in  the  null 
hypothesis  against  which  the  sample  at  time  t is  tested. 

3.  The  sample  size  and  critical  value  for  the  test  is  obtained 
from  equations  (1)  and  (2).  If  the  sample  results  on  an  acceptance 
of  the  null  hypothesis,  then  the  sample  values  are  used  to  update 
the  prior,  resulting  in  the  posterior  distribution.  A new  modal 
value  for  p is  obtained  which  will  be  used  in  the  test  at  time 
t+1,  and  a new  sample  size  and  critical  value  are  obtained. 

4.  If  the  sample  results  in  a rejection  of  the  null  hypothesis  at 
time  t,  then  the  current  prior  is  discarded,  and  the  current 
sample  is  used  to  determine  the  prior  for  the  following  test  of 
hypothesis. 
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